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THE NEW PEDAGOGY 1 
Robert Glcver 

Learning Research and Development Center 
University of Pittsburgh 

If one sets his sights on the shape of pedagogy and instruction in 
the schools of tomorrow, and tomorrow Is not the distant future, what can 
be said about the forces that will influence educational systems? In my 
talk this evening I will venture some opinions about my expectations. I 
will suggest three areas for you? consideration: (1) the indlvlduallza- 

tlon of Instruction; (2) computer-assisted instruction; and (3) psycholo- 
gically-based Instructional design. Many of you might have corrections 
and addition? to contribute which I hope will come up in discussion. 

4 

* - 

Individualisation of Instruction 

By the individualisation of instruction I mean the adaptation of In- 
structional procedures to the requirements of the individual learnor. Tbs 
theme of individualising instruction is a very old one in education , and 
much lip-service is paid to the psychological fact of individual diffe- 
rences in abilities and styles of learning. Educators however continue 

*Thie lecture* presented Rovember 16* 1965, at the University of 
Washington, !* the seventh in a series entitled mmMJ&JMXteV 
The Continuing Challenges . 
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to struggle with the problems of meeting each child's educational needs; 

In the elementary school, serious attempts ere made at grouping within 
the classroom, and recently the ungraded elementary school has attracted 
considerable attention as on opportunity to provide for a greater degree 
of individualised instruction* Efforts like ungraded elementary schools 
will undoubtedly continue and will be important as attempts to tailor 
education to the individual child. However, other solutions are clearly 
needed if we are to approach anything like our Ideals for Individualisa- 
tion of instruction. 

Very early lu this century the work of Washburns and Perkhurst was 
concerned with "an individual system in education." With respect to this, 
in 1926 Dean William S. Gray and his associates concluded that "sufficient 
evidence has been adduced, not in Winnetka alone, but in other schools and 
under differing conditions as well, to make it difficult to justify com- 
placent adherence to traditional mathoda." Over the years political ex- 
pediency end technical difficulties team to have resulted in something 
of a compromise between individualised Instruction end traditional prac- 
tice* £a Cremln points out: "... moat frequently this took the form of 
dividing tha students in each grade into sections of alow, average, and 
rapid learners on the basis of group intalllgsncs taata* This practice 
la fraught with difficulty, since the aptitudes and achit vs m sn t of any 
glvan child may vary considarably from subject to subject." 

The problem of adapting to individual diffarancas in aducatloa has 
bean analysed by Cronbach in terse of several patterns ; these patterns 
which I shall daacrlba are probably not mutually exclusive and ranga from 
historical, to present, to futura posslbllltlas. 
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Pattern one assume* fixed educational goile In a fi^ed educational 
treatment. Individual differences are taken Into account chiefly by 
dropping students along the way. Tests are used to decide which students 
should go faster and be Imbued with higher-educational aspirations. The 
social theory Involved is that every child should "go as far as his abi- 
lities warrant." However* in this case* a weedlng-out process* reached 
oarller or later by various Individuals* Is assumed. 

A orient of the pattern I have just described* which can be called 
"adaptation within a pre-determlned program*" la to permit an individual 
to stay In school until he masters* or at least learns to a specified cri- 
terion* certain essential and conmon educational outcomes. This procedure 
has never been followed In any pure form since It would extend the educa- 
tion of some youngsters until they are oldsters. It Is practiced* how- 
ever* in the old policy of keeping the child In the first grade until he 
can read his primer* and in the more recent non-graded primary unit which 
some children complete In two years and some in four. 

This first pattern of adaptation has two variants then: one In which 
the duration of instruction is altered for an individual by sequential 
selection and veedlng-out * and the other In which the duration of instruc- 
tion is altered by training to a fixed criterion. In both of these pat- 
terns the educational goal for each student Is essentially the same and 
the instructional treatments provided to the student are fixed. 

A second pattern of adaptation to Individual differences Is to deter- 
mine for each student his prospective future role and provide for him an 
appropriate curriculum. He sea this system In operation when students ere 
channeled Into acid s wi c courses* vocational courses* or hoataaking courses 
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or In tine decision to give the vocationally oriented students one kJ id of 
mathematics and the academically oriented another kind. There Is an obvi- 
ous danger in setting differentiated goals, e.g., differentiating mathe- 
matics so that it is the exclusive possession of a selected class while 
other classes are drilled on formulas useful to shopkeepers . (Today the 
theme in mathematics teaching, and In other subjects. Is to give every 
pupil an understanding of the same basic discipline, even though some stu- 
dents go farther, deeper, and broader.) Adaptation to the individual by 
this second major pattern of "matching goals to the individual" is al. j 
operating when a student selects his major field of study In high school 
or college. Adapting tc individual differences by this second pattern as- 
sumes that an educational system has provision for optional educational 
objectives, but within each option the Instructional treatment is rela- 
tively fixed. 

A third pattern of adaptation to Individual differences attempts to 
teach different students by different Instructional procedures; within 
each of these instructional treatments there is a minimum fixed sequence 
of educational goals which must be mastered. This pattern of adaptation 
can be Implemented in a variety of ways: at one extreme a school can pro- 

vide a fixed Instructional sequence and students are pulled off the track 
for remedial work, and then, when the damage is repaired he is put back 
into the general track. At the other extreme, an instructional program 
can provide detailed diagnosis of the student's competencies — his learning 
habits, achievements and skills — on the basis of which a unique prescrip- 
tion la made for a course of instruction specifically tailored to that stu- 
dent. In this letter procedure, some students might ltarn on their own by 
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discovery , tone learn by wore structured methods, some learn by reading, 
some by listening, etc. 

Between these two extremes, toward the direction of the latter, lies 
the kind of adaptation to individual differences that will probably occur 
in the near future. The quality of the system which is developed depends 
upon the answer to many research and practical implementation questions. 
How well can individual student needs be diagnosed? How well can teachers 
write instructional prescriptions based on student information? What is 
the character of the information required? Research indicates that in the 
presence of Inadequate information, it may be best for teachers to follow 
an average treatment for everybody and not attempt to differentiate on the 
basis of unreliable Information; but with reliable information and techni- 
ques for making an Instructional decision, effective student differentia- 
tion is possible. The entire question of the interaction between the 
characteristics of the student at a particular point in his learning and 
the methods* of instruction is raised. An additional problem is practical 
determination of the costs and operating techniques that will make the 
differentiation of instruction suitable to the practical school adminis- 
trator and to the training of the teacher. 

The differentiation of Instructional techniques on the basis of indi- 
vidual-differences variables is an ideal which will demand detailed analy- 
sis that intertwines the methods of experimental psychology and psycho- 
metrics. Proof will have to be forthcoming that the selection and devising 
of instructional methods does Indeed Interact with student differences so 
that their achievement in seeking a given educational goal is significantly 
greater than if an average best method were employed. 

o 
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There are two principal problems in researching and developing systems 
for implementing individualized learning: (i) the psychological study of 

the Interaction between Individual difference variables and learning treat- 
ments, and (2) experimentation in school systems with strategies for adap- 
ting to individual differences. This latter includes, the development of 
appropriate administrative procedures, teacher training, and especially the 
development of appropriate instructional materials (including computerized 
classrooms) end testing instruments. 

The best way to get on with the first problem, i.e., study of the 
interaction between individual differences and learning patterns Is to do 
controlled experiments which Involve the analysis of student histories of 
v .sponse to subject matter as a basis for assigning future instructional 
procedures. 

The second problem involves innovations by school administrators in 
the effort to produce a school environment which is highly responsive to 
the differences among students* What **ou!d such an individualized system 
look like? Bach student would be placed at his achievement level on a 
learning continuum, and hia Instruction would proceed from that point. 
Student performance would be carefully tracked and monitored so that in- 
formation would be provided abcut his style of learning, his rate of 
learning, and his subject-matter mastery* Information would be provided 
about the necessity for more detailed instruction and about attained pro- 
ficiencies which require little additional teaching. With the provision 
of detailed information about student learning progress, the teacher would 
provide instructional decisions in the form of prescriptions for the stu- 
dent's subsequent learning steps* This would be accomplished in a school 
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organization permitting individualized learning to proceed in the absence 
of conventional class boundaries* The teacher would no longer see the 
student as a component of the class but an individual on a continuum of 
achievement. Materials would be provided to maximize the student's self- 
instructional capability and to provide the teacher with a rich resource 
of materials for differentiation among students. 

Automatic data-proceaslng methods would be necessitated by the large 
amount of information obtained for each student and required for effective 
instructional decisions by the teacher. Instructional decision-making in 
the writing of lesson prescriptions would become an increasingly important 
role of the teacher. He would not assign lessons grossly to a group, but 
would be flexible on the basis of the differential Information provided to 
him. 

In building such a procedure, specific technical problems are abundant. 
For example, how does one evaluate the effectiveness of Individually pre- 
scribed instruction? How does one grade and evaluate students in such a 
learning situation? What are the technical problems not only of student 
evaluation but of test construction, materials development, and teacher 
training, for such a system? Furthermore, what are the questions to be 
asked of the data obtained from detailed tracking of the student in indi- 
vidualized learning which can provide a rich resource for studying long- 
term subject-matter learning? 
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Computer-Assisted Instruct Ion 

The second area Influencing a new pedagogy is the use of the comp uter 
for Instruction; and when I say "for instruction/' X preclude the very 
important Influence of large-scale batch data-processing which consists 
of record-keeping In a school, a sc'feool system, or on state-wide basis, 
and also such things as school scheduling, data-bank functions, budgeting 
and accounting. Inventory control, prediction of enrollment, school sum- 
mary statistics, and so on. In contrast, I refer to the fact that during 
the past ten years there has been considerable growth of Interest in pro- 
grammed instruction and teaching machines, and that also during this time, 
there had been >1 rapid development of computer technology. To date, for 
the most part, there has been only sporadic interplay between the teaching 
machine and computer developments, but concern is accelerating along these 
lines. This will be especially true in the light of individualize ■’ instruc- 
tion, since it appears th&fc it will be highly impractical to provide the 
amount of instructional material, the number of teachers and assistants, 
the close monitoring of student performance, and the data-processing re- 
quired for adapting to Individual differences without calling on computer 
capabilities. Two aspects of computer-assisted instruction are of interest 
1) the console or station where the rtudent interacts with the subject ma- 
ter and 2) the analysis of student performance for wise instructional deci- 
sion-making. 

4 

With appropriately designed student stations, a computer-on-line sta- 
tion con provide a rich environment for the student. Kstr ways can be pro- 
vided for him to Interact with and manipulate subject material as he works 
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with it; for example, by means of a cathode-ray tube which looks very much 
like a small television screen, alpha-numeric characters can be generated 
directly by the computer; the student can control these with a standard 
typewriter keyboard. He can also use a device such as a light pen to move 
objects on the screen. Through appropriate audio and video storage devices, 
the computer can control fast-access to sound messages and pictures. A 
young child might manipulate a number line on a cathode-ray tube; he might 
trace letter patterns to learn handwriting The typewriter can accept only 
the correct spelling of a word and prompt him as he makes errors. A high 
school student might learn about the algebraic representation of an equa- 
tion by manipulating different parameters on a keyboard, which change the 
slope and Intercepts of a curve displayed on the cathode-ray tube. A col- 
lege student in a qualitative analysis course in chemistry might analyze 
various materials In a simulated laboratory by indicating his reagents on 
a keyboard and getting a picture of the solution or precipitate that mip** 
be obtained in the actual laboratory. 

What I have just said is the general propaganda by tho**<* In- 
terested in this field, and It is realistically being *t in m own 

laboratory and in others, but there is even more ' mating and hard work 
Involved in the second aspect, that is — the specific problem of instruc- 
tional decision-making. As the student learns, the system must prescribe 
the next instructional step on the basis of information about the student's 
Immediate and more long-term history. An instructional strategy is built 
up on the basis of the student's performance. 
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Consider the following: we have a sub jo*’ after broken down into 

i 

•ub-obj actives that the educator decider ;o ach the student; for each 

sub-objective a test has been conetr * * to assess the behavior defined 

*■ 

by that objective* We also have V. j,ned a set of alternative instruc- 
tional steps which the edir .ms provided for teaching each sub-objec- 
tive* We have then « . . teaching materials which we need to prescribe 

and present tc udent in some order* This order is determined by the 

instruct!* xsions made by the teacher, by the rules we build into 

the c^s*, or by a combination of teacher and computer rules. The in- 
*ng question involved is how the teacher makes instructional ded- 
.ons on the basis of student performance and whether he can be assisted 
by building some of his rules into the computer. (This is somewhat analo- 
gous to saying that we build certain rules info a test in order to score 
it, and the teacher or counselor then uses this test to make decisions 
about the student.) 

Of course, when such decisions are made, we have in mind certain 
criteria which we are trying to optimise* Many things can be considered 
®8 Important criteria, to name a few: a high score on an achievement 

test, the largest Increase between a pretest and a posttest, the t ime 
taken to reach a certain percent correct, performance on a retention test 
given some months after learning, performance on a test of novel in- 
stances of the concept being learned, and the ability and willingness 
of the student to learn similar concepts an hio own and in his own way. 

The important question for research is how the history of student 
performance is to be taken account of and what criteria of performance 
are to be emphasised* The variables involved are several: first, the 
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extra-instructional history of tl 3 student; these are long-range existing 
individual differences, such as aptitudes and learning styles; second, 
the more immediate Instructional history, or those measures obtained in 
the course of instruction which summarise learning status at any point in 
cine; and third, decisions about the next learning step. Efforts to exa- 
mine instructional decision-making rules will involve intensive research 
concerned with the empirical determination of the interaction between long- 
term history effects, measures over the more immediate course of learning, 
the teaching characteristics of a lesson, and the stated criteria for 
learned performance. 

1 have spent a little time elaborating what 1 consider to be an es- 
pecially Interesting problem to be faced in the development of computer- 
assisted instruction. There are others, such as the development of com- 
puter languages which make it. easy for the designers of a curriculum to 
put thexr course in a computer system without being forced to become minor 
expert computer programmers. Such problems obviously require study and 
development, but the solutions certainly appear to be not impossible. 

Two more items should be mentioned in reference to computer-assisted 
instruction, and then I can move on. First is the point that a signifi- 
cant use of computer-assisted instruction is in the design and development 
of Instructional materials. It is reasonable to assume that in the future, 
a mathematics or reading curriculum will be developed and validated on the 
basis of feedback data obtained about how well certain aspects of the course 
teach certain objectives. If certain parts of a teaching sequence do not 
teach well, then data can be obtained on student learning to indicate how 
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that* teaching sequences ate to be revised. A computer-assisted Instruc- 
tional system can provide a means for rather Immediate and detailed analy- 
sis of learning records for curriculum revision. 

The second item is that In addition to the tutorial and drill-and- 
practice aspects of a computer instruction system, it is further possible 
to envision a student station which is essentially an interrogative infor- 
mation-retrieval unit. Here we would like to have a capability wnlch en- 
ables the student to freely construct general questions to which he can 
get reasonable information. The student might like to ask "What were the 
reasons for the depression in the early nineteen-thirties?" or **Why did 
Booth kill Lincoln?" Such systems which can provide to the student in- 
formation in complex matters are certainly , at the present time, difficult 
to consider feasible; but it does seem possible , through a thorough analy- 
sis of the types of questions which might be asked 9 that progress can be 
made toward the recognition of a question by a computer program. The 
central problem seems to be not that of providing the answer, or of storing 
the information appropriate for the answer, but rather that of recognizing 
precisely what question is being asked. 

Finally, in mentioning computer-based instruction I have done a direct 
disservice if I have conjured up any images of 1984 and cold, metallic 
automation. On the contrary, I suspect that efficient use of these tools 
will permit more time to be devoted to huiuanltarlanism — time which we 
seem to be in danger of decreasing. 
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Instructional Design 

I turn now to a third aspect of pedagogy of the future, perhaps some- 
what more difficult to say succinctly. It concerns the emergence of a 
unique speciality called educational technology or Instructional design * 

To elaborate further: The use of modern science In the Interest of society 

has become an Important obligation of our times. This Is true no less In 
education than it is in medicine and engineering. As increasing knowledge 
is accumulated in psychology and the behavioral sciences in general, a 
foundation will be provided for a growing scientific and technological 
base for instructional practice. The translation of scientific knowledge 
into practice requires extensive applied research and technological de- 
velopment. However, at this point in time, an entity to carry out the 
function of ins t ru ct lonal design^ ana de ve lopmen t hardly exists. If a 
person (or organization) carried out such a function, how would he begin 
to work, and in what sort of conceptual framework would he carry out his 
job? I would like to guess at and discuss such a framework and describe 
some of the concepts that an "instructional designer" might use in thinking 
about his work. The tasks he must perform involve the interplay between 
theory, research, and application. I shall mention not application as 
such, but some aspects of the necessary research and development which 
can eventually lead to innovation and redesign in instructional practice. 

The forces encouraging research and development basic to instruc- 
tional practice are the following: (1) The increasing recognition among 

psychologists that their work has been too remote from the many problems 
of classroom learning. This recognition has been spurred on by the basic 
research that led to programmed learning in the form of programmed texts 
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and teaching machine* ; (2) the increasing sophistication of the teaching 
profession which is forcing the behavioral scientist to provide it with 
knowledge relevant to the educational process; and (3) the increasing na- 
tional sponsorship of centers and laboratories dedicated to Mutually sup- 
porting relationships between behavioral science and educational practice* 

Out of these trends will grow the "Instructional designer If such 
a person working in a research and development setting did exist, then it 
can be assumed that he would operate in the following manner* First this 
psychologist-instructional designer would analyse the subject-matter domain 
he is considering — reading, mathematics, or what have you. He would 
think of a domain in terms of the performance competencies which comprise 
it. He would anslyse representative instances of subject-matter competence 
in terms of the nature of the material the student has to attend to and 
the kinds of responses the student makes to this material, e.g., memori- 
sing, concept learning, or problem solving; he would further analyse the 
structure of the subject-matter domain, perhaps in terms of its conceptual 
hierarchies. Second, our Instructional designer would turn his attention 
to the characteristics of the students to be taught. He would need to 
determine the extent to which the students have already acquired some of 
the things to be learned and the extent to which they have certain pre- 
dispositions which might facilitate or Interfere with new learning. 

These first two steps conceivably provide some Information to the 
educational designer about the target performance to be obtained and the 
existing pre-lnstructlonal behavior of the learner. The designer must 
now proceed to get from one state to the other. This sets up his third 
task. This task consists of guiding or allowing the student to go from 
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the prclaitructlooftl behavioral at»ta to a itata of aobjact"«Attar coapa- 
tonco. This raquiraa tha construction of teaching pneaduraa and notarial* 
that axa to ba employed in tha aducatlonal procaaa . Aa part of this pro- 
cess, ha must taka account of motivational af facta and tha ability of hu- 
nana to generalise and extrapolate by providing condition* which will re- 
ault in tha maintenance and extension of tha conpatanca balng taught.. 
Finally, tha aducatlonal daaignar auat make provision for assessing and 
evaluating tha nature of tha conpatanca and kind of knowledge achieved by 
tha learner In relation to son* performance criteria that have bean estab- 
lished. 

So many present-day aducatlonal practlclcners this description of tha 
process of instructional design nay sound harshly technological , and in- 
deed » perhaps sons elegance has been lost in analysis. But presumably, 
once basic techniques are constructed, the teacher can use the tools of 
his profession with understanding, artistry, and sensitivity. 

The design components that I have Just described are: (1) analysing 

the characteristics of subject-matter competence, (2) diagnosing prein- 
structlonal behavior, (3) carrying out the instructional process, and (4) 
measuring learning outcomes. 1 should like to briefly comment further on 
each of thaae. 

Analysing Subject-Matter Competence . First, analysing subject-matter 
competence or whet it it that le to be learned. When the psychologist 
turns hie attention from analysis of standardised arbitrary tasks used 
in tha laboratory to analysis of tha behavior generally taught in school, 
ha runs head-on into the problem of what la coming to ba called teak ana- 
lysis . This is a relatively new phenomenon for the psychologist, because 



In tbt laboratory ks has decided upon and constructed an experimental task 
pertinent to his particular purposes. He is not in a position to do this 
in the educational situation. In the laboratory 9 by preselecting his task 
to tit a problem, he has in a sense analysed its stimulus and response 
characteristics. With real-life subject matter, he is faced with the pro- 
blem of identifying the properties of subject-matter stimuli and their as- 
sociated responses. 

The properties of a subject matter which have been identified by some 
sort of an analysis of tasks, determine the dimensions along which the 
student is taught to generalise and transfer his knowledge. Presumably, 
the ability to transfer is a function of experience with a variety of ex- 
amples and different subject-matter instances. For some dimensions of 
subject matter, there is little ambiguity about teaching for generalisa- 
tion and transfer or about what constitutes a variation of Instances of 
a basic concept. However, as a subject matter becomes more complex, de- 
finition of a range of examples becomes more difficult and problems arise 
concerning whether training in various Instances does indeed carry over 
to new situations. 

The influence of the analysis of subject-matter, dimensions can be 
seen clearly when one considers the teaching of very simple concepts. For 
example, in teaching a child color concepts, such as red and blue, he must 
learn to make the same responses to all members falling within a stimulus 
class and to make different responses to members of different classes. 

That is, the child discriminates between colors but learns to generalise 
to objects which differ in properties other than color — red squares, red 
circles, etc. Once the appropriate dimensions of the task have been analysed 
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they are handled systematically in the teaching procedure, and dimensions 
not relevant to the concept being taught are varied randomly so that the 
student learns to generalise among objects having in common no character* 
is tic other than their color. As a result, the child learns the concepts 
of redness and blueness. This is the simple case however, and the ins true* 
tional proce s becomes complicated w an the subject-matter properties to 
be generalized and discriminated are very subtle. For example, the con- 
cepts of early or late Mozart. A major problem with teaching such subtle 
and complex concepts is analysis and definition of subject-matter proper- 
ties. Such analysis becomes increasingly problematical when there is 
disagreement among experts and where there are semantic imprecislons • 
Sometimes the distinction between classes is not clear to thrt learner be- 
cause he does not have the necessary preliminary training required. At 
other times the confusion is subject-matter imprecision itself. 

Analysis of subject-mstter domain is the first step in the sequence 
of steps required for instructional design, and without it, the succeeding 
components will be inadequate. 

Diagnosing Pre- Instructional Behavior . Once the subject matter and 
the content of the related behavioral objectives have been analyzed, the 
instructional designer turns his attention to the characteristics of the 
learner. This raises all the problems involved in diagnosing preins true* 
tional behavior. At least four classes of preinstructlonal variables are 
determinants of the nature of instruction ** and I exclude here persona- 
lity-type variables. (1) The extent to which the student has already 
learned the behavior to be acquired in instruction. It is not uncommon 
to find, if one gives the final test in a course as a pretest, that a 
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portion of the students display the behavior they are to be taught, (2) 

The extent to which the student has acquired the prerequisites for learning 
the knowledge to be acquired, for example, knowing how to add before learning 
to multiply. Again a pretest often shows the absence of the behavior that 
is necessary for a student to begin new Instruction. (3) The extent to 
which styles of learning or learning sets facilitate or Interfere with new 
learning under certain instructional conditions. (4) A final considera- 
tion is given to aptitude-like variables which consist of the ability to 
make the discriminations necessary to profit from instruction. For ex- 
ample, aptitude in spatial visualization may be necessary in learning solid 
geometry or engineering drawing. These kinds of entering competencies which 

vary among individuals obviously influence what is learned and what can be 
taught. 

In the instructional process, just as the analysis of subject-matter 
competence determines the target behavior to be attained, so does preln- 
structional behavior define the beginning point for guiding behavior 
through teaching. The array of variables and concepts Involved in the 
preln8tructional measurement of aptitudes, readinesses, and diagnostic 
measures of achievement must be systematized for Increased understanding 
of how they Interact with learning and for use in instructional design. 

In the analysis of readiness, for example, measurement of the fact that 
readiness factors differ with age and with individuals must be supple- 
mented by analysis of the conditions influencing these differences and 
of the contribution of these differences to learning. When Is a child 
"normally” capable of distinguishing a b from a d so that it is useful 
to teach him to learn to read? Prevailing norms necessarily presume 
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prevailing learning conditions and not new learning environments . If de- 
signing instructional environments far early ages is considered, it is 
conceivable that the "curriculum" will not be formal subject matters like 

a 

mathematics or reading, but instruction in behaviors which look more like 
basic aptitude-like skills. 

In tackling the problems involved in considering prelnstructional 
repertoires, the Important Jobs are first to investigate the relationships 
between individual difference variables and learning variables — How shall 
individual differences be conceptualised in learning theories? — and sec- 
ond, and more practically, to construct teaching systems for the accomo- 
dation of education to Individual differences. 

Carrying Out the Instructional Process . In the framework I am pre- 
senting, once the terminal objectives and intermediate subobjectives have 
been described, and once the prelnstructional state of the student is des- 
cribed, the instructional process can be carried out. If entering behavior 
is considered state A, and a subsequent performance objective is state B, 
then the instructional process is designed to arrange the student's environ- 
ment to get him, or if you prefer, have him get himself, from state A to 
state B. 

For ease of thinking about the instructional process designed to pro- 
duce subject-matter learning, I shall postulate that at least three kinds 
of processes seem to be involved. One, setting up new forms of student 
response, such as new speaking patterns or a new skill like handwriting. 
Second, setting up new kinds of subject-matter stimulus control, such as 
attaching already learned speech sounds to particular visual symbols. And 
third, maintaining the behavior of the student. This third category is 
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le»s involved with behavior change and more concerned with increasing the 
student's likelihood wo behave, and in this sense falls under the general 
label of motivation. I shall comment briefly on these three categories: 

A very evident characteristic which leads to sub j ect-matter mastery 
is the increasing precision of a student's behavior. In learning complex 
behavior, the student's initial performance is variable and crude itnft 
rarely meets the criteria of subject-matter competence. Effective instruc- 
tional procedure tolerates these initially crude responses and gradually 
takes the student toward mastery. In accomplishing this, the instructional 
process involves the establishment of successively more rigorous standards 
for the learner's performance. This increasing competence is established 
by gradually contracting the permissible margin of error, and gradually 
decreasing the tolerance for exactness. An example of this is teaching 
precise timing and tempo to the music student. The student's beginning 
performance will be quite variable, and performance criteria should be 
initially gross and changed at a rate which assures continuing progress 
toward mastery. Over the sequence of instruction, the range of student 
performance will align Itself with the particular range of acceptable 
performance defined as subject-matter competence which the student reaches 
or exceeds. Inappropriate constriction of performance criteria can be a 
hallmark of Ineffective instruction leading to frustration for the student. 

An equally, if not more significant process In subject-matter learning 
than the one just described is the process of setting up the stimulus con- 
trol of performance. For example, in second language learning, it is easy 
to think about the transfer from an initial repertoire to a target reper- 
toire. In teaching translation, the response "flower" is transferred from 
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thm Kngllsb wo*t» flower to the German word "die Bluae." In learning • con- 
cept, the responses apple, peach, and peer are transferred from the spec!-* 
flc objects to the word fruit. The pertinent Instructional process In- 
volved here Is restructuring the student's entering repertoire so that 
certain responses are transferred to the control of new subject-matter ma- 
terial. The transfer of stimulus control Is a major process Involved In 
teaching students to make responses to more precise subject-matter discri- 
minations, and also in teaching them to use previously learned skills In 
response to new subject-matter dimensions. 

The two processes just described assume only that the behavior of an 
expert in a given subject matter Is characterized by the facility by which 
it is called out by particular subject-matter contexts. However, a further 
characteristic of an expert's behavior Is that it Is apparently self-sus- 
taining. The expert may continue to work for relatively long periods of 
time without seeming external support and without the various supports 
that are needed by the novice. Not only then is the expert's behavior 
controlled by the subject matter, but with Increasing competence it can 
be characterized as self-sustaining. Research on the learning and teaching 
of self-sustaining behavior Is an Interesting problem related, perhaps, to 
exploration and curiosity. 

Conditions Influencing Instruction . Within the kind of rat+gorleg I 
have just described, the task of the experimentalist thinking about in- 
structional design Is to examine the conations which Influence these 
processes. Let me list three aspects especially interesting for research 
and development In instruction. They are: (1) the sequencing of instruc- 

tion — for exaisple, on what basis are the stages of teaching reading to 
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sequenced? ; (2) stimulus and response factors — by what neans of audio 
and visual displays do we best enrich the environment of the learner?; 
and (3) response contingencies — how do we handle schedules of reinforce- 
sent, error correction, and other sources of Instructional feedback? 
Systematic knowledge In answer to such questions Is required for specific 
subject matters. 

Measuring Learning Outc omes . Finally I come to my fourth component 
of Instructional design — the measurement of learning outcomes. It is 
clear that an effective technology of instruction relies heavily upon the 
detailed measurement of subject-matter competence at the beglnniug. In 
the course of, and at the end of the educational process. The Increasing 
emphasis on Instructional design In recent years has raised questions con- 
cerning the nature and properties of measures of student achievement and 
the assessment of subject-matter competence as it may be defined by sub- 
ject-matter scholars. 

Achievement measurement can be defined as the assessment of criterion 
behavior Involving the determination of the characteristics of student per- 
formance with respect to specified standards. However, the scores obtained 
from an achievement test can provide primarily two kinds of Information. 

One Is the degree to which the student has attained criterion performance, 
for example, whether he can satisfactorily prepare an experimental report 
or can solve certain kinds of word problems In arithmetic. The second 
type of Information that an achievement test score provides la the rela- 
tive ordering of Individuals with respect to their test performance, for 
example, whether Student A can solve his problems more quickly than Stu- 
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The principal difference between these two kinds of information lie* 
in the standard need as a reference. The standard against which a stu- 
dent's performance is compared in order to obtain the first kind o? in- 
formation is increasing subject-matter competence along a continuum of 
achievement. The student's score with respect to specific tasks provides 
explicit information as to whet he can or cannot do and indicates the 
correspondence between what the student does and the achievement criteria 
at that point in his learning. Measures cast in terms of such criterion 
standa r ds provide information as to the degree of competence obtained by 
a particular student which is independent of reference to the performance 
of others. 

On the other hand, achievement measures convey the second sort of 
Information about the capability of a student compared with the capability 
of other students. In instances where a student's relative standing is 
the primary purpose of measurement, reference need not be made to criterion 
behavior or achievement standards. Educational achievement examinations, 
for example, are administered frequently for the purpose of ordering stu- 
dents in a class or school, rather than for assessing their attainment of 
specified curriculum objectives. When such norm-referenced measures are 
used, a particular student's achievement is evaluated in terms of a com- 
parison between his performance and the performance of other members of 
the group. Such measures need provide little or no information about the 
degree of proficiency exhibited by the tested behaviors in terms of what 
the individual can do. They tell that one student is more or less pro- 
ficient than another, but do not tell how proficient either of them is 
with respect to the subject-matter tasks involved. In large part. 
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achievement measures currently employed In education are norm-referenced, 
and work needs to be done which will contribute to the development of cri- 
terion-referenced tests In order to assess the outcomes of learning. Cri- 
terion-referenced measures can provide Information about both degree of 
competence and relative standing. Such tests are the kind most helpful 
for the purpose of curriculum evaluation and curriculum design. 

In conclusion, I have attempted to give some of the research approach 
and perspective that Is likely to be introduced Into the design of Instruc- 
tional procedures In the future, as behavioral science and educational prac- 
tice begin to be related In a mutually helpful way. I hypothesise that In 
the future four main areas of the educational process will be Influenced: 

(1) Instructional goals will be analysed In terms of both subject-matter 
content and categories of student behavior that suggest strategies of 
teaching. (2) The diagnosis of the learner's strengths and weaknesses 
prior to Instruction for appropriate guidance will become a more defini- 
tive process so that It can aid In the design of a curriculum specially 
suited for the student Involved. (3) The techniques and materials employed 
by the teacher will undergo significant change. And (4) the ways In which 
the outcomes of education are assessed, both for student evaluation and 
curriculum Improvement, will receive more attention. 

As these changes occur. It Is likely that they will result In certain 
changes In school operation. First, the role of the teacher will be re- 
structured. It seems likely that the teacher will be able to become more 
concerned with Individual student guidance and individual progress In ad- 
dition to his role as a group mentor. Second, the educators' goal of the 
Individualization of student progress based upon student background, 
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aptitude 9 and achievement will come closer to realization by school re- 
organisation and the adoption of new practices. Third, Instructional ma- 
terials and devices supplied by Industry will come under close scrutiny 
as to their instructional effectiveness (just as tests come under dose 
scrutiny with respect to reports on their reliability and validity). 
Fourth, mastery of subject-matter competence will be easier to attain 
for a larger number of people in our schools, and tests which measure pro- 
gress toward mastery will become Important aids for the quality control of 
educational excellence. These developments, necessarily based on a deve- 
loping body of pedegogical principles, should advance teaching toward the 
status of a profession nurtured by underlying behavioral sciences which 
are becoming Increasingly relevant to the educational process. 
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